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Data processing method 



The present invention relates to a data processing method, which data are 
included in an incoming digital image. 

The invention finds its application for detecting ringing noise in a previously 
coded digital image which is thereafter decoded according to a block-based coding technique, 
5 the MPEG standard (Motion Pictures Expert Group), for example, and for the correction of 
the data included in the digital image so as to attenuate visual artifacts caused by the block- 
based coding technique. 



European patent no. 0 817 497 A2 describes a method which permits to reduce 
10 blocking artifacts and artifacts due to the ringing noise of a motion-compensated image. For 
this purpose, the filter method according to the prior art comprises a gradient filter step which 
permits to generate a binary edge map on which global thresholding and local thresholding 
are performed. Said method comprises a step which permits to decide whether an area inside 
the binary edge map, which area is determined with the aid of a filter window, is a 
1 5 homogeneous area or an area containing edges. The method finally comprises a filter step 
which utilizes a first set of predetermined coefficients if the area is homogenous, and a 
second set of predetermined coefficients if the area contains edges, the second set of 
predetermined coefficients being adapted as a function of the position of the contours in the 
area. 

20 

It is an object of the present invention to propose a data processing method 
which permits to detect ringing noise. 

As a matter of fact, if the prior-art method permits to partly correct ringing 
noise, it does not disclose a method which permits to detect said noise. Without the detection 
25 and the localization of this ringing noise, it is difficult to apply a post-processing method that 
is really effective. 

In order to compensate for these drawbacks, the data processing method 
according to the present invention is characterized in that it comprises the steps of: 
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- calculating a spatial activity value of a current pixel based on values of said current pixel 
and of pixels adjacent thereto, 

determining a non-natural uniform area if the spatial activity value of various consecutive 
pixels is lower than a first predetermined threshold value, 
5 - gradient filtering values of the pixels adapted to detect strong edges inside the image, 

- determining an artifact if the spatial activity value of a current pixel is higher than a 
second predetermined threshold value and is concentrated on said pixel, and 

- detecting a ringing artifact if the artifact coming from the artifact determination step lies 
between a non-natural uniform area and a strong edge which are close together. 

10 With such a data processing method, a ringing noise is detected as being a 

pixel having much spatial activity which is likely to appear between a non-natural uniform 
area and a strong edge which are close together in space. The ringing noise detection method 
may thus lead to an improvement of their correction, the filtering following the detection step 
may be applied in an adaptive manner. 

15 Therefore, the data processing method according to the present invention is 

characterized in that it further includes a step of filtering values of pixels lying in a filtering 
area which is between a non-natural uniform area and a strong edge which are close together 
or at least a ringing artifact has been detected. 

Such a data processing method may thus use a first filter for a pixel adjacent to 

20 a strong edge, the coefficients of said first filter depending on the position of the adjacent 
pixel relative to the strong edge, and a second filter for the other pixels of the filtering area. 

The coupling of the processing method of ringing artifacts to a method of 
processing blocking artifacts permits to improve the corrected image quality relative to the 
initial image. 

25 Therefore, the data processing method according to the present invention is 

characterized in that it is associated with a blocking artifact processing method, the second 
method utilizing the same gradient filter step of values of the pixels for detecting a natural 
contour area inside the image. 

The existence of a common step enhances the efficiency of the data processing 

30 method while simplifying the implementation of the association of the two methods. 



These and other aspects of the invention are apparent from and will be 
elucidated, by way of non-limitative example, with reference to the embodiment(s) described 
hereinafter. 
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In the drawings: 

- Fig. 1 is a diagram representing the data processing method according to the 
present invention, 

5 - Fig. 2 illustrates the step of determining artifacts originating from the ringing 

noise for a given configuration of pixel values, 

- Fig. 3 is a diagram representing the step of detecting ringing artifacts, 

- Fig. 4 illustrates the various pixel configurations taken into account by the 
post-processing step according to the invention, 

10 - Figs. 5a, b, c and d illustrate the post-processing step for different 

configurations of pixels comprising non-natural uniform areas and strong edges, and 

- Fig. 6 is a diagram representing the blocking artifact processing method 
according to the present invention. 

15 The present invention relates to a method of processing data which are 

contained in a digital video input signal, said method being intended to improve the visual 
quality of said digital video signal when the latter has previously been coded according to a 
block-based coding technique. 

The data processing method has been developed more particularly in the 

20 framework of coded and decoded digital image sequences according to the MPEG standard. 
The method nevertheless remains applicable to any other digital video signal which has been 
coded and then decoded according to a block-based coding technique such as H.261 or 
H.263, for example. 

Fig. 1 represents a diagram of the data processing method according to the 

25 invention. Said data processing method comprises: 

- a step (ACT) of calculating a spatial activity value of a current pixel based on values (Y) 
of said current pixel and of pixels adjacent thereto, 

- a step (NND) of determining a non-natural uniform area (NN) if the spatial activity value 
of various consecutive pixels is lower than a first predetermined threshold value, 

30 - a gradient filter step (GF) of values (Y) of the pixels adapted to detect (THR1) strong 
edges (SE) inside the image, 

- a step (RC) of determining an artifact if the spatial activity value of a current pixel is 
higher than a second predetermined threshold value and is concentrated on said pixel, 
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- a step (RD) of detecting a ringing artifact if the artifact coming from the artifact 
determination step (RC) is situated between a non-natural uniform area (NN) and a strong 
edge (SE) which are close together, 

- a step (FEL) of filtering the values (Y) of the pixels contained in a filtering area, which are 
5 situated between a non-natural uniform area (NN) and a strong edge (SE) which are close 

together or at least one ringing artifact has been detected. 

In a first instance, it is an object of the data processing method to detect the 
artifacts which are due to the ringing noise. These artifacts generally appear around 

10 considerably contrasting edges. Said ringing artifacts show, depending on the orientation of 
the edges, either a shimmering effect along the contour or a multiple echo effect. 

The method of detecting ringing artifacts is based on the fact that the blocks 
which contain strong edges and are situated in an area of very low spatial activity may be 
ringing artifacts. Therefore, the data processing method comprises first of all a step (ACT) of 

15 calculating a spatial activity value of a current pixel based on values (Y) of said pixel current 
and of pixels adjacent thereto. In the preferred embodiment the spatial activity a(i,j) of a 
current position pixel (i,j) is calculated according to the equations (1) to (3) based on the 
luminance values (Y) of the pixels: 

<Ku)=*n(w)+<Mu) (i) 

20 a h (i, j) = abs(Y(i 7 j) - Y(i, J + 1)) + abs(Y(i, j) - Y(i, j - 1)) (2) 
a v (I, j) = abs(Y(i, j) - Y(i + 1, j)) + abs(Y(i, j) - Y(i - 1, j)) (3) 
where abs(x) is the function that gives the absolute value of x. 

According to an embodiment which is more economic from the point of view 
of implementation, the vertical spatial activity is calculated in the following manner: 

25 a v (u) = abs(Y(i / j)-Y(i + l / j)) (4) 

In this case a single line of the image is stored. Another simplification of the 
method consists of eliminating the very dark and very bright areas where the luminance 
values are very low and very high, respectively. As a matter of fact, natural areas having very 
low spatial activity appear naturally in these types of configurations. 

30 It is then about detecting the areas of very low spatial activity. These areas are 

called non-natural uniform areas here. Actually, they result from a coding and then a 
decoding according to a block-based coding technique, which gives them a substantially zero 
spatial activity, which happens only very rarely for non-coded natural images. In the 
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preferred embodiment the step (NND) of determining a non-natural uniform area (NN) 
detects such an area if the spatial activity value of 5 consecutive pixels is lower than a first 
predetermined threshold value equal to 3. The detection of non-natural uniform areas may 
also be effected over a larger number of consecutive pixels or even over a set of pixels of low 
5 spatial activity in a vertical direction. However, the results obtained with this embodiment are 
sufficiently good for not increasing the complexity of the method. 

The next step then consists of detecting the strong edges (SE). Therefore, the 
detection method of ringing artifacts comprises a gradient filter step (GF) of the values (Y) of 
the pixels contained in the digital input image so as to produce filtered values (G). In the 
10 preferred embodiment said gradient filter step utilizes Sobel filters. Such filters have been 
chosen for they ensure an edge detection which is both robust and efficient. The Sobel filters 
Sh and S v applied horizontally and vertically, respectively, are the following: 

-1 0 1 

(5) 



S H - 



-1 -2 -1 
0 0 0 
12 1 



Sv = 



-2 0 2 
-1 0 1 



The luminance values G H and Gv after filtering are thus Gh = Y.Sh and G v = Y.S V . These 
15 filtered values (G) are then compared with threshold values (THR1). If they are higher than 

the threshold values, a strong edge (SE) will be detected. In the preferred embodiment the 

horizontal threshold value THR1 H and vertical threshold value THR1 V are equal to 150 for 

luminance values varying from 0 to 255. 

This is followed by an artifact determination step (RC). Fig. 2 illustrates the 
20 step of determining artifacts for a given configuration of pixel values. An artifact is 

determined if the spatial activity value of a current pixel is higher than a second 

predetermined threshold value and is concentrated on said pixel. In the preferred embodiment 

an artifact is determined if: 

(o v (i, J) > 3) et (a v (U) > 4 ■ abs(Y(i - 1, j) - Y(i + 1, J))) 

ou (o h (I, j) > 3) et (o h (i, j) > 4 . abs(Y(i, J - 1) - Y(i, j + 1))) ; 

25 Determining the artifact is not sufficient, because areas of natural texture may 

sometimes be considered ringing noise if they are not analyzed in a larger context. Therefore, 
the artifact is analyzed in an area where a ringing artifact is likely to appear, that is to say, in 
an area comprised between a non-natural uniform area and a strong edge. 

Fig. 3 illustrates the step (RD) of detecting ringing artifacts. In an idle state 

30 (IDS), the step does nothing. When a non-natural uniform area (NN) is detected while the 

detection step is in the idle state, the determination step (RD) activates the step of detecting a 
non-natural uniform area (NNS). This step counts the artifacts during a period of M 
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consecutive pixels. After this period (NN) returns to the idle state (IDS). When a strong edge 
(SE) is detected while the detection step is in the idle state, the detection step activates the 
strong edge detection state (SES). This state counts the artifacts during a period of N 
consecutive pixels. 

5 After this period, said state returns ( SE ) to the idle state (IDS). 

If a non-natural uniform area (NN) is detected while the detection step is in a 
state of detecting strong edge (SES), the detection step activates the detection state of a 
ringing artifact (UPS). Similarly, if a strong edge (SE) is detected while the detection step is 
in a state of detecting a non-natural uniform area (NNS), the detection step also activates the 
10 state of detecting a ringing artifact (UPS). This state globally and locally counts the ringing 
artifacts and returns to the state of detecting the non-natural uniform area (NNS) when a new 
non-natural uniform area (NN) has been determined or to the state of detecting a strong edge 
(SES) if a strong edge has been detected. 

Thus, a ringing artifact is detected if the artifact coming from the artifact 
15 determination step (RC) is situated between a non-natural uniform area (NN) and a strong 
edge (SE) which are close together, their proximity being defined by the periods M and N. 

The detection method that has just been described permits to detect whether a 
video signal received by a set top box or a simple television receiver has been coded 
20 according to a block-based coding technique. Depending on the result of the detection 

method, corrective actions are then decided on. These actions are, for example, to apply a 
post-processing method as a function of the data produced by the detection method. 

The data post-processing method according to the invention comprises a filter 
step which does not only apply to the detected ringing artifacts, but to all the pixels in a 
25 filtering area which is located between a non-natural uniform area and a strong edge which 
are close together or at least a ringing artifact has been detected. 

In a first embodiment a linear filter is utilized and the filtering window is 
formed by 3x3 pixels. This filter Hi is the following: 



H, = 



111 
0 0 0 

111 



(7) 



30 



However, as the ringing noises appear very close to the edges, such a filter can 
deteriorate said edges. Therefore, a second embodiment is based on testing the neighborhood 
of a pixel in order to apply the adapted filter. A general approach based on this principle thus 
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consists of carrying out 8 tests and using 16 different filters. In order to reduce the 
complexity of such an approach, only five types of configurations of pixels are taken into 
account. These configurations are illustrated in Fig. 4. The first configuration (CI) 
corresponds to the case where no strong edge has been detected. The second and third 
5 configurations (C2 and C3) correspond to the case where a pixel at the bottom and at the top 
of the filter window, respectively, has been detected as a horizontal strong edge (SHE). In 
that case the pixels adjacent thereto on the left and on the right are considered to be 
horizontal edges (HE). The fourth and fifth configurations (C4 and C5) correspond to the 
case where a pixel on the left and on the right of the filter window, respectively, has been 
10 detected as a vertical strong edge (SVE). In this case the pixels adjacent thereto at the top and 
at the bottom are considered to be vertical edges (VE). 

In these conditions the filter step (FEL) utilizes five different filters (Hi to H 5 ), 
that is to say, a first filter (H2 to H5) for a pixel adjacent to a strong edge (SE), the 
coefficients of said first filter depending on the position of the adjacent pixel relative to the 
15 strong edge, and a second filter (Hi) for the other pixels of the filtering area. 
The filters H 2 to H 5 are the following: 
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Figs. 5a, b, c and d illustrate the post-processing step for the 5 configurations 
of pixels comprising non-natural uniform areas (NN) and strong edge (SVE or SHE). Fig. 5a 

20 corresponds to the configuration C4 for the pixel situated on the right of the strong edge (SE); 
the filter H4 is thus applied to this pixel after which the filter Hi is applied to the other pixels 
situated between the strong edge and the non-natural uniform area. Fig. 5b corresponds to the 
configuration C5 for the pixel situated on the left of the strong edge (SE); the filter H5 is thus 
applied to this pixel and the filter Hi is applied to the other pixels situated between the strong 

25 edge and the non-natural uniform area. Fig. 5c corresponds to the configuration C3 for the 

pixel situated below the strong edge (SE); the filter H3 is thus applied to this pixel after which 
the filter Hi is applied to the other pixels situated between the strong edge and the non- 
natural uniform area. Fig. 5d corresponds to the configuration C2 for the pixel situated above 
the strong edge (SE); the filter H 2 is thus applied to this pixel after which the filter Hi is 

30 applied to the other pixels situated between the strong edge and the non-natural uniform area. 
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The data processing method according to the invention may gain efficiency if 
the post-processing method of ringing artifacts is applied in parallel with the post-processing 
method of blocking artifacts. Fig. 6 represents a diagram of the post-processing blocking 
artifact method according to the invention. Said data processing method comprises: 
5 - the gradient filter step (GF) of values (Y) of the pixels adapted to detect* (THR2) a natural 
contour area (NC) in the digital input image, based on a horizontal threshold value 
THR2 H and vertical threshold value THR2 V , respectively, equal to 35 and 50 for 
luminance values varying from 0 to 255, 
- a blocking artifact detection step (BAD), comprising the sub-steps of: 
10 - calculating (CT) a discontinuity value based on the values (Y) of a current pixel and of 

adjacent pixels of said current pixel, giving the discontinuity values c v and c h based on the 
following equations: 

hsi2-Y{ij) = Y{i-l,j) + Y{i + lj) 
^''Hoifnot (9) 

, jlsi2-Y{ij) = Y{i,j-l) + Y{i,j + l) 
^Hoifnot (10) 

15 - determining (BAC) an artifact value A of the current pixel based on discontinuity values 
of the current pixel and of neighboring pixels of the current pixel, the object of this step 
being to determine a discontinuity centered on the current pixel having position (i,j), and 
a continuity in its vicinity as, for example, with the equation (1 1): 

A(u) = c h (U-l).c^ (11) 

20 where c represents the complementary value of c, 

identifying (ID) blocking artifacts based on artifact values, a horizontal blocking artifact 
or vertical blocking artifact being identified respectively if W consecutive artifacts in a 
horizontal direction or H consecutive artifacts in a vertical direction have been 
determined, H being the height of a block and W its width, 

25 - storing (STO) a position in the image of the blocking artifacts coming from the 

identification step (ID) in tables hTab(i%H) and vTab(j%W), where i is the image line 
where the horizontal blocking artifact is situated, j the image column where the vertical 
blocking artifact is situated and % being the operator which results in the remainder of 
the division of i by H, 

30 - calculating (GRID) a position of a grid that corresponds to the blocks of the block-based 
coding technique from a majority position (imaxjmax) of the blocking artifacts in the 
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tables hTab and vTab, and a grid size from a larger value of counter values that represent 
a number of times that the distance occurs between a current vertical blocking artifact and 
a vertical blocking artifact immediately preceding the latter. 
- a low-pass filter step (LPF) of values (Y) of the pixels coming from the blocking artifact 
5 detection step (BAD), with the exception of the pixels contained in the natural contour 

areas (NC) determined by the gradient filter step. 

The description above with reference to Figs. 2 to 6 illustrates the invention 
rather than limits the invention. It is evident that there are other alternatives which come 
10 within the scope of the appended claims. 

There are many ways of implementing the described functions by means of 
software. With regard to this, the Figs. 2 to 6 are highly diagrammatic, each Figure 
representing a single embodiment. Thus, although a Figure shows various functions in the 
form of separate blocks, this does not exclude that a single software item carries out various 
15 functions. This does not exclude either that one function can be carried out by a set of 
software items. 

It is possible to implement these functions by means of circuit of a television 
receiver or of a set top box, said circuit being suitably programmed. A set of instructions 
contained in a programming memory may cause the circuit to carry out various operations 

20 described earlier with reference to Figs. 2 to 6. The set of instructions may also be loaded in 
the programming memory by reading a data carrier such as, for example, a disc that contains 
the set of instructions. The reading may also be effected via a communication network such 
as, for example, the Internet. In that case a service provider will make the set of instructions 
available to interested parties. 

25 No reference sign in parentheses in a claim must be interpreted in a limiting 

fashion. The word "comprising" does not exclude the presence of other elements or steps 
stated in a claim. The word "a" preceding an element or a step does not exclude the presence 
of a plurality of these elements or of these steps. 



